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Many Users, Many Opinions 


As Datapro’s subscribers keep telling us, a summary of 
users’ evaluations of the pros and cons of the myriad 
products offered to the data processing community can 
be a valuable tool in selecting the product that will best 
meet each computer user’s needs. That kind of informa- 
tion is often hard to come by, however, which accounts 
for the increasing popularity of the “User Reaction” sec- 
tions of Datapro’s reports on computer systems, proprie- 
tary software, and peripheral products. 


To quote the Latin poet Terence, “many men, many 
opinions,” and this 1974 survey of user ratings of general- 
purpose computer systems summarizes the opinions of 
our subscribers about their satisfaction with their cur- 
rently installed computer systems. Datapro solicited 
these views in an extensive questionnaire mailed on a 
postpaid reply form to more than 8200 Datapro sub- 
scribers in June 1974. 


By the end of July, when the monumental task of tabu- 
lating the responses was begun, a total of 878 question- 
naires had been returned. Of these, 60 responses were 
received from users of minicomputers and small account- 
ing computers. These responses were excluded from the 
tabulated results of this survey and will be incorporated 
in the user experience sections of future editions of two 
other Datapro reports, All About Minicomputers and All 
About Small Accounting Computers. 


Seven Datapro subscribers generously took the trouble 
to return the survey form with an indication that they 
have no in-house computer installation at present and 
could supply no information relevant to this survey. Ten 
questionnaires were returned in which the respondents 
had not completed the user ratings section, primarily 
because the users felt that their computer systems had 
not been installed long enough to be definitively evalu- 
ated. Regrettably, an additional 59 questionnaires con- 
tained no identification of the respondents and had to 
be excluded from the tabulated results. Datapro consci- 
entiously protects the identity of all participants in our 
user satisfaction surveys, but questionnaires returned 
with no identification cannot be validated and thus can- 
not be incorporated into the final results of the surveys. 


All general-purpose computer systems of any vintage 
were grouped and included in the tabulated totals if they 
were rated in three or more valid responses. Single re- 
sponses describing a model of a currently marketed 
product line were incorporated into the appropriate 
computer family’s totals under the category of 
“Others.”’ 


In the case of questionnaires that described two or more 
computer systems representing more than one main- 
frame manufacturer or more than one model within a 
product line, each set of ratings was counted as one 


This report presents the results of an extensive 
Datapro survey and tabulates the experience of 
752 users with a total of 1288 computer systems. 
The users’ ratings pinpoint the strengths and weak- 


nesses of each manufacturer’s equipment, software, 
and support, yielding information that should be of 
great value in computer acquisition. 


response. However, when only one set of ratings was 
given for multiple computer systems of the same model 
or series, that set of ratings was counted as a single re- 
sponse in order to avoid skewing of the final ratings by- 
one installation reporting on a large number of identical 
computer systems. As a result, our 752 valid question- 
naires add up to a total of 1016 responses evaluating a 
total of 1288 computer systems from 9 manufacturers. 


Our comprehensive questionnaire asked each Datapro 
subscriber to describe his computer installation in con- 
siderable detail. Each respondent was asked to identify 
the manufacturer and model number of the computer 
system, the number of systems installed, the main 
memory size, and the operating system in use. 


Another question asked whether the user acquired his 
system by outright purchase, rental from the manufac- 
turer, or through a third-party leasing arrangement. The 
results, listed in Table 1, represent the percentages of the 
total number of responses for each computer manufac- 
turer that signified each type of acquisition. Since some 
respondents failed to supply an answer to this question, 
the percentages do not always add up to 100%. 


What Are All Those Computers Doing Out There? 


We then asked our subscribers to describe the major 
functions of each computer system by indicating the 
principal application, or applications, performed by each 
system. The results are shown in Table 2. Here the per- 


centages always far exceed 100%, indicating that most of B> 


TABLE 1: METHOD OF ACQUISITION 


Rental from | Third-Party 
Manufacturer _ Manufacturer | Lease 


Burroughs 
Control Data 
DEC 
Honeywell 
{BM 

NCR 

Singer 
Univac 
Xerox 


Totals 


©1974 DATAPRO RESEARCH CORPORATION, DELRAN, N.J. 08075 


SEPTEMBER 1974 


REPRODUCTION PROHIBITED 


70C-010-50b 
Computers 


User Ratings of 
General-Purpose Computer Systems 


TABLE 2: PRINCIPAL APPLICATIONS 


. Business Data Scientific and | Real-Time | Data Commu- Data Base 
Manufacturer Processing Engineering Control nications Management Others 


Burroughs 
Control Data 
DEC 


Honeywell 


IBM 
NCR 
Singer 
Univac 
Xerox 


Totals 


<> the computer systems represented in the survey perform 


a variety of functions. Not surprisingly, with the excep- 
tion of the computers made by Control Data, Digital 
Equipment Corporation, Singer, and Xerox, the empha- 
sis is still heavily in the area of business data processing. 
The next highest activity is represented by data commu- 
nications. 


The high percentages in the “‘Others” category for Con- 
trol Data, DEC, and Xerox are comprised mainly of en- 
tries for instruction, research, and administration in edu- 
cational institutions. 


The next question asked the computer users “Who wrote 
the programs for your applications?” Table 3summarizes 
their replies. Although the vast majority of users main- 
tain in-house programming staffs, most also have turned 
to other sources for programming assistance. Hence, the 
figures in Table 3 also total more than 100 percent in 
most cases. 


Computer users represented in the survey relied most 
often on software packages supplied by independent 
software houses to supplement their in-house program- 
ming efforts. These results underscore the growing im- 
portance of proprietary software industry in the com- 
puter marketplace. The percentages listed in Table 3, 
however, probably underestimate the full extent of the 
utilization of proprietary software packages by com- 
puter users; our question specified application programs 
only, and many of the popular proprietary software pro- 
grams supplement the services performed by the com- 
puter manufacturers’ systems software. 


The percentage of computer users in the survey who 
were using remote batch and/or interactive terminals var- 
ied widely. But all of the manufacturers had some repre- 
sentation in both categories, as shown in Table 4. 


All told, the 1016 responses accounted for a total of 
2971 remote batch terminals and 13,411 interactive ter- 
minals. The number of each type of terminal installed 
per system naturally varied widely with the sizes of the 
computer systems. 


The final question relating to the description of each 
configuration asked the users to specify what types of 
peripheral devices, if any, they had obtained from 
sources Other than their mainframe manufacturer. The 
results are shown in Table 5. Responses in the “Others” 
category included printers, graphic plotters, MICR 
devices, and various types of remote terminals and 
front-end communications processors. As expected, the 
use of “foreign” peripheral devices is most common 
among users of IBM computers, who can choose from a 
wide variety of plug-compatible devices. But the figures 
also make it clear that many users of other makes of 
computers are now looking to alternative sources for 
some of their peripheral equipment. 


A Matter of Opinion 


Finally and most importantly, in order to determine the 
level the users’ satisfaction with their computer systems, 
we asked each respondent to judge his system in 11 
distinc: -ategories of performance by assigning ratings of 
Exceiient, Good, Fair, or Poor. These responses were 
groupeé by computer model, and weighted average 
based on the number of responses for each category was 
computed. To calculate the weighted averages, each Ex- 
cellent response was weighted as 4, Good as 3, Fair as 2, 
and Poor as 1. The total numbers of responses were 
multiplied by their corresponding weights, and the sum 
of these products were then divided by the total number 
of responses in each category. The results for each com- 
puter model that was rated by three or more users and 
the totals for each mainframe manufacturer are pre- 
sented in the detailed tables on the next four pages. 


We feel obliged to make a few qualifying statements 
about these ratings in order to further clarify the results. 
In the first place, readers with a penchant for addition 
will discover that the numbers of responses listed for a 
given rating category often fail to add up to the total 
number of user responses indicated for that computer 
system. Not every user rated his computer system in all 


11 categories, often because he felt that one or more of => 
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TABLE 3: SOURCES OF APPLICATIONS PACKAGES 


Computer 
Manufacturer's 
Personnel 


In-House 


Manufacturer 
Personnel 


Burroughs 
Control Data 
DEC 
Honeywell 
IBM 

NCR 

Singer 
Univac 
Xerox 


Totals 


> the categories did not apply to his installation. The most 
striking example is the category for the mainframe man- 
ufacturers’ Applications Programs, to which only 63% of 
the respondents supplied a rating. Only those responses 
which assigned a rating were included in calculating the 
weighted average for each category. 


In the Ease of Conversion category, however, the num- 
ber of users who did not supply a rating, or who speci- 
fied Not Applicable, probably had some effect on the 
resulting ratings. In perusing these questionnaires, Data- 
pro discovered that a number of computer users who 
actually had upgraded to new computer models within a 
manufacturer’s product line checked off Not Applicable 
in the Ease of Conversion category. The transition must 
have been so painless that some users felt they hadn’t 
gone through a conversion, although other respondents 
with similar experiences could as easily have rated Ease 
of Conversion as Excellent. 


Some Mixed Emotions 


In order to establish a base-line or standard of perfor- 
mance, we computed weighted averages for all responses 
for each of the mainframe manufacturers. 


TABLE 4: REMOTE TERMINAL USAGE 


pha tittecinan Remote Batch 
pom Terminals 


Burroughs 
Control Data 
DEC 
Honeywell 
iBM 

NCR 

Singer 
Univac 
Xerox 


Interactive 
Terminals 


Tocal 


““Ready Made” 
Programs from 
Manufacturer 


Used 
Proprietary 
Software 
Packages 


Used 


Used Contract 
Programming House 


In addition, the ratings provided by all of the computer. 
users in this survey are summarized in Table 6 to form 
an overall picutre of user satisfaction—and in some cases 
dissatisfaction—with their computer systems. The figures 
in Table 6 represent the percentage of Excellent, Good, 
Fair, and Poor ratings supplied for each performance 
category by all of the 1016 responses. 


Thus, a resounding 90% of the computer users who re- 
sponded to Datapro’s survey supplied a Good or Excel- 
lent rating for Overall Satisfaction with their currently 
installed computer systems. To halt the spread of a rosy 
glow probably now emerging on the faces of computer 
marketing managers from Armonk to San Diego, it 
should be noted that comparable expressions of good 
will on the part of these computer users appeared in 
only two other categories: Ease of Operation, where 
92% of the respondents bestowed a Good or Excellent 
rating, and Reliability of the Mainframe, where 92% of 
the users also rated their experience as Good or Excel- 
lent. 


On the other hand, the responding computer users de- 
scribed themselves as most dissatisfied with the applica- >> 


TABLE 5: USAGE OF “FOREIGN” PERIPHERALS* 


Mainframe Magnetic Add-On 
Manufacturer Tape Drives| Main Memory 


Burroughs 
Control Data 
DEC 

Honey well 
iBM 

NCR 

Singer 
Univac 
Xerox 


Total 


“Peripheral devices obtained from sources other than the 
mainframe manufacturer. 
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Computer No. of Reliability of Reliability of | Responsivness of | Effectiveness of 
Manufacturer User Mainframe Peripherals Maint. Service Maint. Service 
and Model Replies 


Burroughs B 1700 
Burroughs B 2700 
Burroughs B 3500 
Burroughs B 3700 
Burroughs B 4700 
Burroughs B 6700 
Burroughs, others 


Burroughs Totals 


Control Data 3100 Series 
Control Data 6000 Series 
Control Data, others 


Control Data Totals 


Digital Equipment 
DECsystem-10 


Honeywell Series 200 
Honeywell Series 2000 
Honeywell Series 600/6000 
Honeywell, others 


11 


Honeywell Totals 


IBM 360/20 
IBM 360/22 
IBM 360/25 
IBM 360/30 
1BM 360/40 
IBM 360/50 
IBM 360/65 
IBM 360/75 
IBM 360/91 
IBM System/360, others 


“OP AMONQNA 


!BM System/360 Totals 


{BM 370/125 
IBM 370/135 
iBM 370/145 
1BM 370/155 
IBM 370/158 
{BM 370/165 
IBM 370/168 
IBM System/370, others 


IBM System/370 Totals 
1BM 1130 


IBM 1401 
1BM 1440 


NOTE: All ratings are expressed in terms of number of user responses. The legend is E for Excellent, G for Good, F for Fair, and P for Poor. 
WA is the Weighted Average, calculated on a scale of 4 for Excellent, 3 for Good, 2 for Fair, and 1 for Poor. 
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Technical Operating Compilers and Applications Ease of Overall 


Computer Support Systems Assemblers Programs Conversion Satisfaction 


Manufacturer 
and Model 


Burroughs B 1700 
Burroughs B 2700 
Burroughs B 3500 
Burroughs B 3700 
Burroughs B 4700 
Burroughs B 6700 
Burroughs, others 


omfhm- On 


= 
(2) 


Burroughs Totals 


Control Data 3100 Series 
Control Data 6000 Series 
Control Data, others 


Control Data Totals 


Digital Equipment 
DECsystem-10 


Honeywell Series 200 
Honeywell Series 2000 
Honeywell Series 6(00/6000 


Honeywell, others 
Honeywell Totals 


IBM 360/20 
IBM 360/22 
IBM 360/25 
IBM 360/30 
IBM 360/40 
{BM 360/50 
IBM 360/65 
IBM 360/75 
IBM 360/91 
{BM System/360, others 


oOoOnr]0N "ON 


IBM System/360 Totals 


N 
= 


IBM 370/125 
{BM 370/135 
IBM 370/145 
IBM 370/155 
IBM 370/158 
IBM 370/165 
IBM 370/168 
IBM System/370, others 


ooo-fohsho 


IBM System/370 Totals 


IBM 1130 
IBM 1401 
IBM 1440 


o=--f i<e) 
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Computer . Ease of Reliability of Reliability of Responsiveness of Effectiveness of 
Manufacturer Operation Mainframe Peripherals Maint. Service Maint. Service 
and Model 


IBM System/3 Model 10 3.7] 24 i E : 210 {3.6} 22 

| IBM System/3, mode} 3.6 ; A : 110]3.2] 3 
unspecified 

{BM System/3 Totals : . x : 3/0 }3.5] 25 


IBM Totals 

NCR Century 100 

NCR Century 101 

NCR Century 200 

NCR Century, others 
NCR Century Totals 
NCR 315 

NCR Totals 

Singer System Ten 

Univac 9200 

Univac 9300 

Univac 9400 

Univac 9000 Series, otherg 
Univac 9000 Series Totals 


Univac Series 70/45 
Univac Series 70, others 


Univac 1106 
Univac 1108 
Univac 1110 
Univac 1100 Series Totals 


Univac 490 Series 


Univac Totals 


Xerox Sigma Series 
Xerox, others 


Xerox Totals 


RECAP OF TOTALS 
BY MANUFACTURER 


Burroughs 

Control Data 
Digital Equipment 
Honey well 

IBM 

NCR 

Singer 

Univac 

Xerox 


OMOOONO-N 
ONO -00W 


Totals for manufac- 
turers other than IBM 3.4}119]119]14)1] 3. , 3.2] 871124] 36412.9 58/125] 61 


Grand Totals 3.4|421]521]53/3] 3.5/553} 389) 56) 14] 3. 3.21329] 538] 109) 5] 3.1] 259/542) 163/12 


NOTE: All ratings are expressed in terms of number of user responses. The legend is E for Excellent, G for Good, F for Fair, and P for Poor. WA 
is the Weighted Average, calculated on a scale of 4 for Excellent, 3 for Good, 2 for Fair, and 1 for Poor. 


©1974 DATAPRO RESEARCH CORPORATION, DELRAN, N.J..08075 
REPRODUCTION PROHIBITED SEPTEMBER 1974 


Computer 


Manufacturer 
and Model 


IBM System/3 Model 10 

IBM System/3, model 
unspecified 

{BM System/3 Totals 


IBM Totals 

NCR Century 100 
NCR Century 101 
NCR Century 200 
NCR Century, others 
NCR Century Totals 
NCR 315 

NCR Totals 

Singer System Ten 
Univac 9200 

Univac 9300 


Univac 9400 
Univac 9000 Series, others 


Univac 9000 Series Totals 


Univac Series 70/45 
} Univac Series 70, others 


"Univac 1106 
Univac 1108 
Univac 1110 


Univac 1100 Series Totals 
Univac 490 Series 
Univac Totals 


Xerox Sigma Series 
Xerox, others 


Xerox Totals 
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Burroughs 

Control Data 
Digital Equipment 
Honey well 

{BM 

NCR 

Singer 

Univac 

Xerox 


Totals for manufac- 
turers other than IBM 
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Y> tions programs supplied by the mainframe manufac- 


turers. They also revealed their displeasure with the 
quality of technical support provided by most main- 
frame manufacturers by giving that category the highest 
percentage of negative (Fair or Poor) responses of any 
category in the survey. Although the great majority of 
these computer users described themseives as satisfied 
with the reliability of their mainframes, only 79% of 
them gave a Good or Excellent rating to their peripheral 
devices for reliability. Finally, no manufacturer scored 
an average of good (3.0) or better in all 11 performance 
categories, indicating that from the point of view of the 
users, the products and services provided by all of the 
major computer manufacturers could stand improve- 
ment. 


And Some Well-Deserved Accolades 


There were some outstanding performances described in 
the survey, however, and even considering the relatively 
small sample sizes for some product lines, the accom- 
plishments of some of the computer manufacturers 
deserve special notice. Burroughs Corporation, for exam- 
ple, scored an outstanding 3.7 rating for its operating 
systems and 3.5 for its compilers and assemblers in com- 
parison to overall average ratings of 3.0 and 3.1, respec- 
tively, for these two categories. Xerox Corporation and 
Digital Equipment Corporation also received ratings well 
above the overall averages in these two software cate- 
gories. 


Three manufacturers—Burroughs, Digital Equipment 
Corporation, and Xerox—were given ratings above the 
average for all computer systems in Overall Satisfaction, 
with the DECsystem-10 leading all the others with a 3.7 
rating in this “bottom line” category. NCR Corporation 
also achieved some notable successes receiving above- 
average ratings for its maintenance service (an area where 
computer users often grumble), for its applications pro- 
grams (where users often are displeased with the gen- 
erality of the programs and equally displeased if none 
are provided), and for ease of conversion (another cate- 
gory in which very few bouquets were thrown). 


Since IBM computer systems comprised some 75% of 
the total computer systems represented in our survey, 
their users’ responses naturally had a strong effect on the 
overall ratings for all computer systems. In addition, we 


TABLE 6: OVERALL PERFORMANCE RATINGS 


Ease of operation 
Reliability of 
mainframe 
Reliability of 
peripherals 
Maintenance service: 
Responsiveness 
Effectiveness 
Technical support 
Operating system 
Compilers and 
assemblers 
Applications programs 
Ease of conversion 
Overall satisfaction 


were curious to see how all the non-IBM computer sys- 
tems stacked up against the manufacturer that controls 
the largest chunk of the general-purpose computer mar- 
ket. All in all, most of the “‘others” turned in a pretty 
creditable performance. In fact, all of the non-IBM sys- 
tems lumped together equalled IBM’s score in the user 
ratings for Overall Satisfaction. Since the non-IBM 
systems collectively received lower ratings than their 
IBM counterparts in five other categories, at first glance 
it doesn’t seem to add up. We can only conclude that in 
many cases users are willing to discount slight imperfec- 
tions in some areas in order to avail themselves of other 
advantages offered by the smaller computer manufac- 
turers, such as lower cost, specialized data processing 
capabilities, or expertise in selected industry sectors. 


Thank You 


Datapro wishes to thank all of our subscribers for 
responding so enthusiastically to our first major 
survey of user experience with general-purpose 
computer systems. Without your participation, it could 
not have been a success, and we hope that this 
compendium of the opinions of your colleagues will be 
of significant value to you. We are looking forward to 
hearing from you again next year.O 
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